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I .  Introduction 

It  is  well  known  that  in  linear  programming  the  knowledge  of  optimal  dual 
variables  can  be  used  to  simplify  the  finding  of  an  optimal  solution  to  the  pri¬ 
mal  problem.  In  this  paper,  the  analogous  notion  is  considered  for  nonlinear 
and  particularly  nonconcave  programming  problems.  A  new  theoretic  result  on 
Lagrange  multipliers  is  presented  which  enables  one  to  make  a  statement  for  non¬ 
linear  problems  similar  to  the  above  assertion  for  linear  programs. 

Consider  the  problem 

(P) :  maximize  f (x) ,  subject  to 

g(x)  <  0, 

where  f:  Rn  +  R,  g:  Rn  -*■  Rm.  Let  represent  the  constraint  set  (feasible 

points)  for  this  problem.  That  is 

Sq  *  {xeRn :  g(x)  £  0}. 

Assume  that  all  functions  in  (P)  are  twice  continuously  differentiable  and  that 
(P)  has  at  least  a  local  solution,  say  x*.  That  is,  x*  is  in  and  there 

exists  a  neighborhood  of  x*,  say  N(x*),  such  that  f(x*)  £  f(x)  whenever  x 
is  in  N(x*)  n  S^.  Assume  that  a  constraint  qualification  holds  at  x*  [2]. 
Then  the  following  Kuhn-Tucker  optimality  conditions  are  valid: 
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There  exists  a  nonnegative  vector 

X* 

in 

Rm  such  that 

V 

Vf (x*)  - 

n 

I 

i-i 

x*i 

V 

{X*,g(x*)) 

- 

0 

(complementary  slackness) . 

In  this  context  the  following  question  may  be  posed.  Suppose  that  the  above 
X*  vector  is  known,  but  that  x*  is  unknown.  How  might  one  then  use  the 
knowledge  of  X*  to  determine  either  x*  or  possibly  some  other  local  solution 
to  (P)? 

If  (P)  is  a  concave  program  (f(x)  concave,  g^  (x)  convex,  j**l,...,m)  the 
answers  to  this  question  are  known.  In  particular,  in  this  case,  the  Kuhn- 
Tucker  conditions  are  sufficient  as  well  as  necessary  for  optimality  (i.e.,  if 
the  pair  (x*,X*)  satisfies  and  then  x*  is  a  solution  to  (P) .  Also 

any  x*  satisfying  also  (globally)  maximizes  the  Lagrangian  function 

L(x,X*)  ■  f(x)-£™m^  since  for  concave  programs  the  Lagrangian  is  a 

concave  function.  If  the  Lagrangian  is  strictly  concave,  then  x*  will  be  its 
unique  global  maximizer.  If  the  Lagrangian  is  not  strictly  concave  then  there 
may  be  a  set  of  vectors,  including  x*,  each  member  of  which  maximizes  the 
Lagrangian  (thus  satisfying  C^) .  In  this  case,  any  feasible  member  of  the 
set,  which  also  satisfies  C^,  is  a  solution  to  (P) .  Thus,  whenever  (P)  is  a 
concave  program,  a  knowledge  of  X*  permits  the  statement  of  a  conceptual  pro¬ 
cedure  which  is  necessary  and  sufficient  for  determining  solutions  to  (P)  in  the 
sense  that  it  is  guaranteed  to  be  failsafe.  This  procedure  is  the  following. 
Find  among  the  set  of  Lagrangian  multipliers  one  that  also  satisfies  feasibility 
and  complementary  slackness.  The  procedure  is  failsafe  in  that  x*  is  such  a 
quantity. 

If  (P)  is  not  concave,  then  there  are  at  least  two  serious  difficulties: 

(1)  There  is  no  convenient  way  of  determining  the  vectors  x  which 
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satisfy  the  system 

m 

v  Vf(x)  -  l  X*.  Vg.(x) 

i“l  1  x 

D2:  g(x)  £  0 

D3:  (X*,g(x))  -  0. 

In  particular,  in  the  nonconcave  case,  the  global  (local)  solutions  to  (P)  will 
not  generally  be  global  (local)  maximizers  of  f  (x)-^_1X*igi(x) . 

(2)  The  Kuhn-Tucker  conditions  in  the  nonconcave  case  are  not  generally 
sufficient.  Hence,  even  if  all  solutions  to  the  above  system  can  be  found,  there 

A 

is  not  a  known  way  of  selecting  the  solutions  to  (P)  from  the  set  of  vectors  x 
which  satisfy  D^,  D£  and  D^.  (Second  order  information  could  be  used  but  there 
are  no  known  necessary  and  sufficient  second  order  conditions.  Hence,  concept¬ 
ually,  second  order  information  does  not  solve  the  problem.) 

Thus,  in  the  case  of  nonconcave  programs,  (P) ,  the  usual  Lagrangian  function 
appears  to  be  of  limited  use  as  a  vehicle  for  answering  the  question:  Can  a 
knowledge  of  X*  be  theoretically  related  to  a  procedure  for  solving  (P)? 

In  this  paper,  we  consider  the  extended  Lagrangian  function  [3] 

m 

(1.1)  P(x,k,e)  -  f(x)  -  l  0. [exp(kg. (x))-l] , 

n  i-l  m 

where  x  e  R  ,  k  is  a  nonnegative  scalar,  and  0  e  R  .  Recall  that  x*  is 

some  unknown  local  solution  to  (P) ,  X*  is  a  known  nonnegative  dual  variable, 

and  the  pair  (x*,X*)  satisfies  the  Kuhn-Tucker  conditions  D^,  D2  and  Dy  We 

now  wish  to  assume  that 

(i) :  x*  satisfies  the  second  order  sufficiency  conditions  [4] 

(ii) :  X*^  >  0  for  every  i  such  that  gi(x*)  ■  C. 

Under  these  conditions,  it  will  be  shown  that  there  exists  a  positive  scalar  K 
such  that  if  k*  £  K,  and  if  0*^  *  X*^/k*,  i  *  l,...,m,  then  x*  is  a  local 
maximizer  of  P(x,k*,3*),  and  any  local  maximizer  of  P(x,k*,0*)  also 
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satisfying  an<*  ^3  *s  a  l°cal  solution  to  (P) .  Thus,  from  a  knowledge  of 
X*,  we  are  able  in  theory  to  determine  a  local  solution  to  (?)  by  the  following 
failsafe  procedure:  conduct  a  search  among  the  local  maximizers  of  P(x,k*,3*) 
for  one  which  satisfies  D2  and  D^.  The  procedure  is  failsafe  in  that  x*  is 
such  an  element.  Thus,  in  non concave  programs,  although  the  usual  Lagrangian 
function  has  restricted  theoretic  application,  it  is  seen  that  the  Lagrange 
multipliers,  X*,  continue  to  play  a  key  theoretic  role  as  dual  variables.  The 
use  of  an  extended  Lagrangian  function  allows  one  to  extend  the  theory  of  con¬ 
cave  programs  in  a  parallel  way. 

In  another,  but  related,  context  it  will  be  shown  that  the  function 
P(x,k,3)  actually  has  a  local  saddle  point  at  x*,  k*,  3*,  and  consequently 
the  results  herein  have  an  interpretation  in  the  framework  of  duality  notions 
for  nonlinear  programs. 

The  present  work  has  been  motivated  by  a  desire  to  improve  the  computational 
theory  for  solving  nonconcave  problems.  Although  immediate  computational  im¬ 
plications  of  the  above  described  results  are  not  clear,  it  is  hoped  that  this 
work  will  lead  to  a  better  understanding  of  nonconcave  programs  and  thereby 
stimulate  other  efforts  to  obtain  computational  advances. 

In  Section  2,  the  main  result  is  stated  and  proved.  Following  a  discussion 
in  Section  3,  the  duality  interpretation  is  demonstrated  and  discussed  in 
Section  4.  An  example  and  application  are  presented  in  Sections  5  and  6, 
respectively. 


II,  Results 


Let  the  problem  (P)  and  x*  be  defined  as  above.  Suppose  f  and  g  are 
twice  continuously  differentiable,  and  that  the  weak  constraint  qualification 


5 


holds  at  x*.  Let  I  denote  the  index  set  of  active  constraints.  That  is, 

I  *  ji  €  {1,2 . m}:  gi(x*)  ■  oj. 

Let  X*  be  a  nonnegative  vector  such  that  (x*,A*)  satisfy  D^,  D2  and 
(i.e.,  X*  is  an  optimal  dual  variable,  or  Kuhn-Tucker  multiplier).  Now  de¬ 
fine  the  extended  Lagrangian  P(x,k*,3*),  as  in  (1.1),  by  setting  k*  >  0  and 
3*i  -  xyk*,  i  «  1,2, ...,m. 

LEMM  la  (x,v,X*)  satisfy  D^,D2»D^  if  and  only  if  (x*,k*,3*)  satisfy 

m 

G. :  0  *  VP(x*,k*,3*)  -  Vf(x*)  -  J  3*  exp(k*g. (x*))k*Vg. (x*) 

1  i=l  1  1  x 

G2:  gi^x*^  ^  i  *  1,2, ... ,m 

G3:  $*±  «  3*t  exp(k*g1(x*)) ,  i  »  l,2,...,m. 

Proof:  For  Ml,  G3  holds  iff  3^-0,  iff  \*±  =■  0,  iff  D3  holds. 

For  i  c  I,  g^x*)  -  0  so  that  both  G3  and  D3  hold.  Also,  x*  is  assumed 
to  be  a  local  solution  to  (P)  and  hence  D2  and  G2  (feasibility)  are  trivially 
satisfied.  Thus  the  system  G^,  G2,  G 3  is  equivalent  to 

(I)  0  -  Vf (x*)  -  [  k*  3*  Vg  (x*). 

iel 

Similarly,  the  system  D^,  D2,  D3  is  equivalent  to 

(II)  0  =  7f(x*)  -  l  X*  Vg  (x*). 

itl 

Finally,  it  follows  from  the  assumption  3*^  *  A^/k*,  each  i,  that  (I)  and 
(II)  are  the  same.  □ 

Lew  2 1  If  a  constraint  qualification  holds  at  x*  then  for  any  positive  k* 


there  exists  a  nonnegative  vector  3*  such  that  (x*,k*,3*)  satisfy  G^,  G2, 
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Now  consider  the  Hessian  of  the  extended  Lagrangian  at  x*: 

(2.1)  V2P(x*,k*,$*)  -  V2f (x*)  -  l  k*$*  V2g  (x*)  -  £  (k^23*.Vg  (x*)VTg ,  (x*) 

iel  11  id  11  1 

-  72L(x*,X*)  -  k *  l  X*,7g  (x*)VTg,(x*) 

i«I  1  1  1 

where  L(x,A*)  is  the  usual  Lagrangian  function  discussed  in  Section  1.  Note 
that  if  V2L(x*,A*)  is  negative  definite,  then  V2P(x*,k*,3*)  is  also,  because 
in  (2.1)  each  term  of  the  sum  is  a  dyadic  matrix.  Even  when  V2L(x*,A*)  is  not 
negative  definitive,  however,  the  dyadic  terms  will  under  certain  conditions 
cause  V2P(x*,k*,$*)  to  be  negative  definite.  Let  B  *  {id:  A*i>0},  let  S 
be  the  subspace  spanned  by  (Vg^x*):  ieB},  and  denote  the  orthogonal  complement 
of  S  by  SA. 

THEOREM  1.  Suppose  that,  in  addition  to  D^,  and  D^,  (x*,A*)  also  satisfy 

D^:  for  each  nonzero  zeS1,  zTV2L(x*, A*) z  <  0.  Then  there  is  a  positive  scalar 
K  such  that  for  any  k*  >  K  and  3*^  ■  A*^/k*,  i  ■  1,2, ...,m  the  Hessian 
V2P(x*,k*,3*)  is  negative  definite.  Consequently,  x*  is  an  isolated  local 
maximizer  of  P(x,k*,3*). 

REMARK!  If  the  nondegeneracy  assumption  A5"^  >  0,  id  is  made,  then  assuming 
that  (x*,A*)  satisfy  D^,  and  is  equivalent  to  assuming  that 

(x*,A*>  satisfy  the  second  order  sufficiency  conditions  discussed  by  Fiacco 
and  McCormick  in  [4]. 

PROOF  OF  THEOREM  1i  (i)  If  S  -  {0}  then  S1  *  Rn,  in  which  case  implies 
that  V2L(x*,A*),  and  hence  V2P(x*,k*,3*)  for  any  positive  k*,  is  negative 
definite.  In  this  case,  the  result  holds  for  any  K  >  0. 

If  S  ^  {0},  consider  the  continuous  function  h:  S  +  R  defined  by 

h(y)  ■  yT  l  A* .Vg. (x*)VTg. (x*)  y  *  l  A*  (yTVg. (x*))2. 
ieB  1  1  1  J  ieB  1  1 

For  any  yeS  such  that  y  i  0,  h(y)  >  0,  hence  h  takes  a  minimum  >  0 

on  the  compact  set  U  ■  {yeS:  ||y||  °  1}.  Now  denote  M  B  ||  V2L(x*,A*)||  ,  the 
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sup  norm  of  the  matrix  V2L(x*,A*). 

ii)  If  S  ■  Rn,  then  for  every  veS  such  that  v  +  0, 

vTV2P(x*,k*,B*)v  *  vTV2L(x*, A*)v  -  k*h(v) 

£  M||v||2  -  k^llvll2. 


In  this  case,  the  result  holds  for  K  *  M/m^. 


iii)  Finally,  suppose  {0}  i  S  5  Rn.  Than  S1  4  {0}.  For  any  zeS1  ?  z^O, 
zTV2L(x*,A*)z  <  0,  hence  zTV2L(x*, A*)z  has  a  maximum  -n^  <  0  on  the  compact 
set  V  =*  (zcS1:  ||z||«l}.  For  any  V€Rn  JyeS,  zeS1  3  v«y+z.  Then 


vT v2P(x*,k*,e*)v  *  (y+z)TV2L(x*,A*) (y+z)  - 

.  T 


(y+z) 


k*  l  A*  Vg  (x*)VTg  (x*) 
icB  1  1 


(y+z) 


zTV2L(x*, A*)z  +  2yTV2L(x*,A*)z  +  yTV2L(x*, A*)y  -  k*h(y) 


*  -m2||  z||2  +  2M 1 1 y  ||  ||  z||+  M||y||2-  k^Hy 


-  -k*m1|| y|| 2  -  m2< II  z|| ||y||)2  +  ““||y||2  +  Mllyl|2 

“  ||y||2(-k*m1+-|-  +  K)  -  m2(||z||  - ||y||)2 

Hence,  if  k*  >  K  =  ^-  (l+~),  then  vTV2P(x*,k*,$*)v  <  0  for  any  nonzero  v. 

X  2 

□ 


III,  Discussion 

For  the  program  P  as  defined,  with  local  maximum  at  x*  and  nonnegative 
vector  A*  such  that  (x*,A*)  satisfy  the  Kuhn-Tucker  conditions,  suppose  A* 
is  known.  In  the  concave  case,  with  no  further  assumptions,  this  information 
can  be  used  to  find  a  global  solution  to  P.  With  the  above  results,  we  can  now 
make  a  similar,  but  somewhat  weaker,  statement  in  the  nonconcave  case.  Under  the 
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additional  assumption  that  holds,  there  is  a  value  K  >  0  such  that  if  we 
set  k*  >  K  and  B*.^  ■  A*j/k*  for  i  «  l,...,m  then  (x*,k*,B*)  will  satisfy 

G^,  an<^  and  the  Hessian  of  the  extended  Lagrangian  P(x,k*,8*)  will  be 
negative  definite  at  x*.  This  means  that  P(x,k*,3*)  will  have  a  local  un¬ 
constrained  maximum  at  x*.  Furthermore,  we  can  show  that  any  local  (global) 
maximizer  of  P(x,k*,B*)  which  satisfies  feasibility  and  complementary  slack¬ 
ness  will  be  a  local  (global)  solution  to  P.  For  example,  suppose  x  is  a 
global  maximizer  of  P(x,k*,B*)  and  suppose  xeS^  and  that  (x,A*)  satisfy 
the  complementary  slackness  relations  D^.  Then  V  xeRn 

A  m  A  m 

f(x)  -  l  6*  [exp(k*g.(x))-U  2  f(x)  -  l  0*  [exp(k*g.(x))-l], 

i-l  11  i-i  1  1 

which  implies 

m 

f(x)  ^  f(x)  +  l  B*  [exp(k*g  (x))-exp(k*g  (x))] 
i-l 

m 

«  f (x)  +  l  0*i[l-exp(k*g1(x))), 
i“l 

which  implies  f(x)  e  f(x)  x  in  S^.  Hence  x  is  a  global  solution  to  (P) . 
The  argument  for  local  solutions  is  analogous. 

Thus,  given  A*  under  the  stated  conditions,  we  formulate  the  extended 
Lagrangian  in  the  form  (1.1)  and  then  search  amonp  its  local  maximizers  for 
points  x  which  also  satisfy  feasibility  and  complementary  slackness.  There 
will  be  at  least  om  such  point  x,  namely  x*,  and  each  such  x  will  be  a 
local  solution  to  (P) .  Note  that  this  procedure  will  not  directly  yield  a 
global  solution  to  (P) ,  unlike  the  concave  case.  If  the  points  x  include  a 
global  solution  to  (P)  (for  example,  if  x*  is  a  global  solution),  it  will  be 
recognizable  only  to  the  extent  that  if  x^  is  a  global  solution  to  (P)  and 
if  x  is  any  other  local  maximizer  of  P(x,k*,B*)  satisfying  feasibility  and 
complementary  slackness,  then  P(x,k*,B*)  ^  P(x^,k*,B*). 
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IV.  Duality 

Under  the  assumptions  in  Section  2,  we  have  P(x,k*,B*)  £  P(x*,k*,B*)  V  x  6 
tf(x*) ,  some  neighborhood  of  x*,  because  x*  is  a: local  unconstrained  maxi¬ 
mizer  of  P(x,k*,3*).  Also,  because  (x*,A*)  satisfies  complementary  slackness, 
and  since  x*  is  feasible, 

m 

P(x*,k*,B*)  “  f(x*)  -  l  8*  [exp(k*g,(x*))-l]  -  £<x*)  s  P(x*,k;;) 

i-1  1  1 

V  k  2  0,  8  k  0.  Thus,  V  xcN (x*) ,  k,8  k  0, 

P(x,k*,8*>  £  P(x*,k*,8*)  S  P(x*,k,8) . 

This  shows  that  for  each  fixed  k*  sufficiently  large,  the  function 

P(x,k,8)  “  f(x)  -  l  X./k  [exp(kg  (x))-l] 

1=1  1  1 

has  a  local  saddle  point  at  (x*,k*,B*).  Fix  k*  sufficiently  large  and  define 
a  dual  function,  as 

iKB)  *  max  P(x,k*,B). 
xeN(x*) 

Then  we  have 

f(x*)  *  min  iKB)  31  iKB*)  • 

3>0 

We  note  here  that  the  dual  problem  is  precisely  the  problem  of  determining 
an  exact  penalty  function  for  the  primal.  In  other  words,  to  solve  the  dual,  it 
is  necessary  to  find  a  B*  such  that  x*  is  a  local  solution  to  maxP(x,k*,B*) , 
provided  k*  is  sufficiently  large.  Fletcher  [5]  has  obtained  at  least  a 
theoretic  and  possibly  a  computational  advance  in  penalty  function  techniques 
by  presenting  exact  penalty  functions  for  equality-constrained  problems.  However, 
there  has  to  date  appeared  no  computationally  useful  type  of  differentiable  exact 
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penalty  function  for  nonconcave  inequality-constrained  problems.  The  present 
function  P(x,k*,$)  is  no  exception,  since  there  are  not  acceptable  known  pro¬ 
cedures  for  determining  $*  in  nonconcave  cases.  Most  known  applicable  pro¬ 
cedures  would  involve  general  cutting  plane  techniques  in  the  6  space,  such 
as  the  Dantzig-Wolfe  decomposition  [6J  or  the  procedures  of  Nemhauser  and 
Wldhelm  [7].  These  procedures,  at  the  present  state  of  theory,  could  firstly  be 
employed  only  to  find  a  $*  corresponding  to  a  global  solution  to  (P)  and 
secondly  they  would  require  an  infinite  sequence  of  global  optimizations  of  non¬ 
concave  functions,  which  would  appear  to  be  unacceptable. 


V.  Example 

One  point  in  the  development  thus  far  should  perhaps  be  further  emphasized. 

We  have  shown  that  if  x*  is  a  local  solution  to  (P) ,  and  if  (x*,A*)  satisfy 
the  conditions  thru  D^,  then  x*  is  a  local  unconstrained  maximizer  of 
P(x,k*, A*/k*)  for  all  k*  sufficiently  large.  However,  the  theory  admits  the 
possibility  of  nonuniqueness.  That  is,  if  x  is  any  other  local  unconstrained 
maximizer  of  P(x,k*, A*/k*)  such  that  g(x)  £  0  and  A*^g^(x)  “0,  i  *  l,...,m 
then  x  is  a  local  solution  to  (P) .  We  have  not  been  able  to  impose  weak  con¬ 
ditions  w!  ich  rule  out  this  possibility.  However,  note  that  if  such  an  x  exists 
then  from  A*^g^(x)  *  0,  i  -  l,...,m,  it  follows  that  A*^  >  0  implies 
g^(x)  ■  0.  That  is,  i€B  implies  g^(x)  *  0.  Also, 

Vf(x)  -  l  Vg.(x). 
ieB  1  1 

This  means  that  the  optimal  dual  variables  A*  corresponding  to  x*  are  also 
optimal  for  x.  For  nonlinear  problems,  though  this  is  clearly  possible,  it 


intuitively  seems  "unlikely". 


11 


As  an  Illustration  of  Theorem  1,  consider  the  following  simple  quadratic 
example. 

max  x^,  s.t. 
x  -  2  s  0 
-x  -  1  s  0. 

In  this  case>  there  are  two  local  solutions,  namely  -1  and  +2.  The  global 
solution  is  x*  «  2,  with  corresponding  optimal  dual  variables  A*^  ■  4, 

X*2  ■  0.  That  is,  (x*,A*)  satisfy  the  Kuhn-Tucker  conditions.  The  function 
P(x,k*,A*/k*) ,  is  given  by 

P(x,k*, A*/k*)  -  x2  -  ^  (fcXp(k*(x-2))-l). 

Note  that  here  S  -  R,  S1  «  {0},  is  trivially  satisfied,  and  Theorem  1 

holds  for  k*  >  K  *  •-.  It  is  not  difficult  to  verify  that  P(x,k*, A*/k*)  has 
the  shape  illustrated  by  Figure  1. 


Although  the  function  P  is  not  concave  in  x  (for  any  k),  it  is  to  be 
noted  that  in  this  case  there  is  only  one  local  unconstrained  maximum  and  this 
occurs  at  x*  ■  +2.  Note  also  that  the  function  P  has  no  global  maximum. 
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VI.  Application 

It  is  generally  thought  to  be  the  case  that  if  the  optimal  response  function 
is  differentiable  then  the  partial  derivatives  are  given  by  the  optimal  dual  var¬ 
iables  However,  for  nonconcave  programs,  a  proof  of  this  result,  under 

reasonable  assumptions,  is  not  known.  In  this  section,  we  offer  such  a  proof 
under  the  following  assumptions. 

A^:  x*  is  a  unique  global  solution  to  (P) . 
the  assumptions  of  Theorem  1  hold. 

A^:  the  following  stability  conditions  hold  (see  [1]) 

(i)  3^0?  is  compact,  where  1  is  the  m-vector  of  ones 

(ii)  (xeRn:  g(x)  <  0}  is  nonempty  and  the  closure  of  this  set  is 
equal  to  S^,  the  constraint  set  in  (P) . 

A^:  the  optimal  response  is  differentiable  at  b  ■  0  (it  is  not  known 
whether  this  assumption  is  redundant  to  A^,  and  A^) . 

The  optimal  response  function  can  be  precisely  defined  as  follows.  Let 


■  (xeR1*:  g(x)  <  b},  where  b€Rm, 


and  let 


B  -  {beRm:  Sb  0  0} 


The  optimal  response  function  f.  :  B  •+  R  u  {+«}  is  defined  as 

-6  Up 


f4Up( b)  ■  dupf(x),  s.t.  x  e  Sb- 


IHEOREM  2:  Under  the  assumptions  thru  A^, 


3f 


3b 


j 


b-0 


j  ■  1*  ...»  m. 


PROOF:  By  Theorem  1,  x*  is  an  isolated  local  maximizer  of  P(x,k*,B*),  where 
3*  m  x*/k*  and  k*  is  sufficiently  large.  Hence,  3  e  >  0  such  that 
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P(x*,k*,6*)  >  P(x,k*,8*)  V  *  3  ||x-x*||  *  e.  Let  D  -  (xeRn:  ||x-x*||  £  e},  and 
consider  the  problem 
(h  max  f (x) 

X  €  D 


g(x)  S  0. 

Let  “  4upf(x),  s.t.  g(x)  <  b,  xeD.  We  first  observe  that  x*,  k*,  8* 

4  Up 

satisfy  the  following  three  conditions: 

(i)  P(x*,k*,8*)  >  P(x,k*,3*)  V  x  e  D 

(ii)  g(x*)  0 

(iii)  3*1[exp(kgi(x*))-l]  -  0,  i«l,...,m.  (By  Gy) 

Consequently,  x*,  k*,  8*  solve  the  extended  constrained  Lagrangian  problem  dis¬ 
cussed  in  [2 j .  It  follows  from  results  in  the  latter  paper  that  the  function 

m 


z(b,k*,A*) 


4 


I 

j-1 


xyk*  [exp(k*bj)-l]  +  ^(0) 


is  a  support  to  ^Up(")  at  (0.  in  the  sense  that  ^Up0>) 

z(b,k*,X*)  V  beB.  If  we  can  now  show  that  i  (b)  ■=  f,  (b)  for  all  b  suf- 

-6  Up  4  Up 

ficiently  near  zero,  it  will  follow  that,  for  j  e  {l,...,m}, 


3W0) 

3b. 


9z 


9b 


j 


3b, 


(0,  k*,  A*) 


and  the  proof  will  be  complete. 

To  show  the  required  result,  let  N^^CO)  denote  a  family  of  balls  of 
radius  1/n  about  the  origin  in  Rm  and  suppose  that  in  each  of  these  neigh¬ 
borhoods  there  is  a  point  b  such  that  (b  )  +  f1#  (b  ).  We  note  that 

n  4  up  n  4  up  n 

since  b^  +  0,  the  sets  are  eventually  compact  and  nonempty  and  +  Sq 

in  the  Hausdorff  metric.  It  was  shown  in  [1]  that  these  results  are  implied  by 

the  stability  conditions  A^.  By  the  eventual  compactness  of  the  sets  Sbn,  for 

all  n  sufficiently  large  there  is  an  x  eSu  such  that  f(x  )  *  f.  (b  ). 

n  un  n  4up  n 

Now,  since  f .  (b  )  ^  f  (b  ) ,  it  follows  that  none  of  the  elements  x  are 
*  4  up  n  4  Up  n  n 


14 


D.  Hence  a  subsequence  of 
-x*||>  e.  But  since 

f(x)  *  £imf(x  ) 


converges 

(V  +  V°>* 


^up<bnj) 


to  some  xeS 
we  have 


(0) 


such  that 


-  f(x*), 


which  contradicts  the  uniqueness  of  f(x*).  Thus  we  have 
for  all  b  in  some  neighborhood  of  zero.  □ 


Vk> 


(b) 
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